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Abstract 

This paper uses an incremental matrix expansion approach to derive asymptotic eigenvalue dis- 
tributions (a.e.d.'s) of sums and products of large random matrices. We show that the result can be 
derived directly as a consequence of two common assumptions, and matches the results obtained from 
using R- and S-transforms in free probability theory. We also give a direct derivation of the a.e.d. of 
the sum of certain random matrices which are not free. This is used to determine the asymptotic signal- 
to-interference-ratio of a multiuser CDMA system with a minimum mean-square error linear receiver. 
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I. Introduction 

Asymptotic analysis of linear multi-input multi-output communications systems has yielded 
significant insights into their performance and design (e.g., see [1] and references therein). In 
particular, asymptotic, or large-system, analysis of the minimum-mean-squared-error (MMSE) 
receiver has been studied extensively for code-division multiple-access (CDMA) systems, using 
results such as the Silvers tein-Bai theorem [2], Girko's law [3], and free probability [4,5]. 

Free probability is concerned with non-commutative random variables, of which asymptotically 
large random matrices are a canonical example. In free probability, the notion of independence 
(from commutative probability theory) is replaced by the notion of freeness. Methods for finding 
the asymptotic eigenvalue distribution (a.e.d.) of sums and products of free non-commutative 
random variables were developed by Voiculescu [6,7], and apply what are known as the R- and 
S -transforms, respectively. Recently, free probability has been used to analyze several aspects of 
communications systems [8-13]. 

In this paper, we show that for asymptotically large random matrices, these sum and product 
a.e.d.s can be derived in a more direct manner than in [6, 7]. The derivations arise directly as 
a consequence of two conditions (which ensure freeness), and do not rely on non-commutative 
free probability theory. Instead, we apply an incremental matrix expansion approach [14], which 
is a generalization of the techniques used in [2, 15]. Similar, yet different derivations of these 
results can also be found in the mathematical physics literature [16, 17], however we believe the 
derivations found there are less accessible. These derivations help to explain key results from 
free probability theory, in particular, the R- and S-transforms. 

The incremental matrix expansion approach can also be used to determine the a.e.d. of sums 
and products of certain non-free random matrices. This was demonstrated in [14], where we 
previously considered the large-system transient performance of adaptive least-squares receivers. 
In this paper, we extend the approach in order to consider certain multi-user CDMA systems in 
frequency-selective channels, which includes the single-cell multiple-signature-per-user uplink 
and the multiple-cell downlink. Specifically, we consider direct-sequence (DS) and multi-carrier 
(MC) CDMA systems, which are well known to be equivalent in the large system limit (see e.g., 
[18]), and as such we refer to the common model as DS/MC-CDMA. We previously presented 
an approximate solution to a special case of this problem in [18, 19], where a sum of non- 
free matrices is approximated by a sum of equivalent unitarily invariant matrices, which are 
asymptotically free. In this paper, we determine an exact solution to the problem, which is also 
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significantly easier to compute than the approximate result in [18]. A special case of the solution 
is seen to agree with results in the mathematical literature [20]. Numerical examples show that 
the exact large-system results closely match simulated finite-system results. 

II. A.E.D.'s Of Sums and Products of Unitarily Invariant Matrices 

In [14], we outlined an extension to the approach of [2] for computing the a.e.d. of certain 
types of large random matrices using elementary matrix operations. This approach gives the 
same results as would be obtained if results from free probability^ were used, but the derivations 
are more direct. Here we show that the a.e.d. 's of sums and products of free random matrices 
can also be derived using this approach. 

The a.e.d. of sums and products of asymptotically free random matrices can be computed, 
respectively, using the so-called R- and S-transforms from free probability, given the a.e.d. of 
each component term [6,7]. This is analogous to the way the Fourier transform is used to 
compute the distribution of a sum of scalar independent random variables. As such, R- and S- 
transforms are often described as performing additive or multiplicative free convolution of the 
component distributions. In what follows, we will show that the sum and product distributions 
can be derived in a more direct manner, which does not explicitly require free probability results, 
but depends on two assumptions satisfied by canonical examples of free random matrices [5]. 

According to [5, Theorem 4.3.5], an independent family of NxN Hermitian random matrices^ 
0^j)j=i J almost surely asymptotically free as — > cxo provided that for each j = 1, . . . , J: 

Assumption 1 Xj is unitarily invariant. That is, the joint distribution of the matrix elements is 
invariant to left or right multiplication by unitary matrices. 

Assumption 2 The empirical distribution function (e.d.f.) of the eigenvalues ofl^j almost surely 
converges in distribution to a compactly supported probability measure on W as N ^ oo. 

We shall define Xj as a scalar random variable according to the a.e.d. of for each j — 1, . . . , J. 

'a straightforward introduction to free probability can be found in [12, Section V], which also contains references to further 
information. 

^Notation: All vectors are defined as column vectors and designated with bold lower case; all matrices are given in bold 
upper case; (■)^ denotes Hermitian (i.e. complex conjugate) transpose; (•)* denotes the operation X* = XX^; tr[-] denotes the 
matrix trace; | | and || || denote the EucUdian and induced spectral norms, respectively; Ijv denotes the NxN identity matrix; 
and, expectation is denoted E[-]. 
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A. Ramifications of AssumptionsU\^ 

1) Assumption \l\ (Unitary Invariance): Denote the singular value decomposition of Xj as 
VjD^Vj. Due to the assumption of unitary invariance of Xj, without loss of generality we 
may assume that is independent N x N Haar^ unitary. In what follows, Vj ^ denotes the /c* 
column of Vj and Dj^k denotes the diagonal element of for 1 < j < J and 1 < A; < A^. 

2) Assumption^ (Convergence of empirical distributions): From [21], Assumption |3 implies 

1 ^ 

k=l 

almost surely, where / : M* — M* is any (fixed) bounded continuous function on the support of 
Xj. Denote -Dmax = maxj<jsup^ which is finite due to Assumption|2| 

We shall assume that the distribution of Xj, j = 1 . . . J, is non-trivial, i.e., does not have all 
mass at zero, since we shall require E[Xj] > 0. 

B. Sums of Unitarily Invariant Matrices 

We wish to determine the a.e.d. (i.e., as ^ oo) of J2j=i where the Xj are Hermitian, 
N X N independent random matrices satisfying Assumptions [l] and |2l Equivalently, it is more 
convenient to determine the Stieltjes transform"^ of the distribution, which may then be inverted. 
That is, we seek Gdz) = lim^v-^oo G^{z) where G^{z) = -i:tr[C^-'^] and C = —zlj\f + J2j=i ^i- 
To simplify the proof, we shall also assume \z\ < oo. 

Before we begin the formal derivation, we first explain the general method we use. Following 
the approach in [14], it can be seen that at some point, the matrix inversion lemma will be used 
to remove column k of Vj from C, which will give a term of the form 

(2) 

where Cj^k is C with Vj ^ removed from Xj. Now, in order to analyze such a term asymptotically, 
typically the next step is to convert this quadratic form into an expression involving a matrix 
trace. Since Vj jt is a column from a Haar distributed matrix, the term in (O can be evaluated 
asymptotically from Lemma |5] in Appendix U which gives 

v],,C7iv,,, X _ _ ^f li^N - V,V] + v,,,vt ,)CTi] = vt ,C7iv,,, (3) 

square random matrix fl is Haar distributed if its probability distribution is invariant to left or right multiplication by any 



constant unitary matrix. 

''The Stieltjes (or Cauchy) transform of the distribution of a random variable X G R* is E[ j^^^ 
transform variable, and — {x \ x £ C, Im(a;) > 0}. 
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where x denotes "asymptotic equivalence", as defined in Definition [T] in Appendix HI Unfortu- 
nately, this tells us nothing new about Q. Therefore, we introduce an intermediate step in the 
derivations, where we reduce the rank of to some value K < N, and consider the asymptotic 
limit {N,K) oo with K/N a where a E (0, 1). The result we seek is then obtained by 
letting a go to unity from below, denoted a ^ 1^ . 
Formally, we seek 



Gc{z) = lim Gc{z,a) (4) 



where 



K/N 



Gc{z,a)= lim Gc{z,a) , a G (0, 1), (5) 

{JV,if)-.cx) 



(6) 



C = ~zlN + Y,±j, (7) 



X, = (V,D,)^ (8) 

and Vj contains the first K < N columns of V^ , and is the corresponding K x K submatrix 
of D, . 

Following the incremental matrix expansion approach described in [14], the next step is to 
remove column k of from C, i.e., C = Cj^k + -Dj,fcVj,fcvj ^. We have 

C-\,= (9) 

from the matrix inversion lemma, where p'^^ = vj^Cj^v^ fe. It is shown in Appendix HH that 

max p . fc - p . — > (10) 

k<K ■' 



as (A^, K) ^ oo with K/N ^ « G (0, 1), where 



T,- = - V, Vj (12) 
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Expanding the identity 1^ = CC ^ using ® gives 
1 = ^tr[CC-i] 

^ J K 

K 



J 



—zGriz-, a) + aJ — a — — 

j=i k=i ■'''^^J 



N 



(13) 
(14) 

(15) 

We now concentrate on a realization for which ([T]) and (fTOb holds. Under this assumption, it 
is shown in Appendix |ll| that 

1 1 



and similarly, we have from (fTTT) 

1 



1 — a 



Gci^^ a) — a 



1 ^ 



N 



max 

k<K 



max 

k<K 



N 



1 + D,,kPf,, 1 + D,^,p^ 











1 + D,,kPf,k 1 + D,,kPf 
Moreover, due to Lemma IT] in Appendix |T| and ([T71)-(fT51). we have 

1 



-t(- 



+ D,,kPlk 1 + A-.fcP. 

N 



N 



Pj,k 



Pi 



Dj,kPj,k 1 + Dj,kP 



It now follows from O, O, d), CSll, and (|20l) that 



Gciz,a) - Gc{,z,a) 



Pj — Pj\ ^ 0, j = 1, . . . , J, where Gdz, a) and p^, j = 1, . . . , J, satisfy: 



(^0(2;, «) = —z ^ ll — a J + a S 



Pi 



a{£^ - 1) + 1 



(17) 
(18) 

(19) 

(20) 
and 

(21) 
(22) 



and £^ = E 



As discussed at the beginning of this section, taking a ^ 1 in (ETT) and (E^ . we obtain the 
J + 1 simultaneous equations in the variables Gciz), pj, j = 1, . . . , J, given by 

Gciz 



J-1 



Gciz) 



1 



Xj+p- 



J 



(23) 
(24) 
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Since a solution to these equations exists and is unique [22, Theorem 2.1], we have that G^{z) — > 
Gc{z) with probability 1. 

Finally, it can easily be verified that this result matches that obtained using the R-transform 
from free probability theory [6]. We emphasize that this derivation does not explicitly rely on 
free probability results; rather it relies only on Assumptions [T]-|2l 

C. Products of Unitarily Invariant Matrices 

We wish to determine the a.e.d. (i.e., as — > oo), of 11/=! -^i where the Xj are as 
defined previously. Equivalently, it is more convenient to determine the Stieltjes transform of 
the distribution. That is, we seek Gq{z) = limTv^oo where B = —zl^ + fl^^^Xj. 

In what follows, we assume J = 2 in order to simplify the derivations. Of course, the result 
may be applied recursively to obtain the a.e.d. for J > 2. Also, to simplify the proof, we shall 
assume that \z\ < oo. 

As explained in Section Hl-BL rather than attempting to derive G^{z) directly, we consider 
an associated problem where the rank of Vj, j = 1, . . . , J, is reduced to K. We then take the 
asymptotic limit (A^, K) ^ oo with K/N oo, and obtain the desired solution by taking a to 
unity from below. That is, we define 

Gb{z) = lim Gsiz^a) (25) 

a— 



where 

K/N^a 

B ' 



GB{z,a)= lim Gl{z,a) ,«g(0,1), (26) 

{JV,if)-.cx) 



Gf(^,a) = ^tr 



(27) 

B = -zIn + X1X2 (28) 



and Xj is defined in dU). 



As in Section III-BL the next step is to remove column k < K from Vj within B. Define 
Bi^fc = B — -Di,fcVi,fcv| ^X2 and 62,^ = B — D2,k^iV2,k^l f From the matrix inversion lemma. 



we have 



v^X2B-V,, = — (29) 
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where 



(32) 
(33) 



and we have used V2 f^'B^ \v2,k 



.-1 



which follows from B2 k^2 k = —z^r2 , 



It is shown in Appendix Hill that 



max TT- — vr, 

k<K I ^ 



N\ g 



(34) 



for i = l,2, as (A^, K) ^ 00 with K/N ^ a G (0, 1), where 

1 



TT, 



AT 



N-K 
1 



:tr 



:tr 



TaB^Xi 



and Yj is defined in (fT^ . 

Expanding the normalized trace of the identity I^v = BB^^ using (l29t and (l30b we obtain 

' Ek=iDi,k^L±2B-Wi 



(35) 
(36) 



1 + ^6-^(^,0) 



1 1 

= C( > irr , ? = 1, 2 

and similarly expanding (l35t using (I29b - (l3n) we obtain 

AT _ Q / _ ^2,k L 



(37) 



(38) 



(39) 



We now concentrate on a realization for which ([T]) and (l34l) holds. Under this assumption, it 
is shown in Appendix [nil that 



max 



max 

k<K 



max 

k<K 



1 


1 








Dj,k 


1 + 




<^ 




1 + 


1 + 







(40) 

(41) 
(42) 



for J = 1,2. 
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It now follows from O, (EH), (E21), and that 



G^i^y ^) " Gb{z, a] 



0, < 



N 



0, and \tt2 — tt2\ 0, where G'b(z, a), tti, and tt2 satisfy 

1 + zGb{z, a) = 
GB{z,a) = 





1 








1 




2:7ri7r2 - 


1) 



J = 1,2. 



TTi] - 

(43) 
(44) 



To obtain the final solution we take a ^ 1 in (l43t and (l44l) to obtain three simultaneous 
equations in the variables Gb{z), tti, and 1^2, given by 

1 



Gb{z) 
Gb{z) 



z 



J = 1,2. 



(45) 
(46) 



z{z'Ki7T2 - 1) 

Since there exists a unique solution to these equations [22, Theorem 2.4], we have that G^{z) 
Gb{z) with probability 1. 

It can easily be verified that this result matches that obtained using the S-transform from free 
probability theory [7]. Again, we emphasize that this derivation does not explicitly rely on free 
probability results; rather it relies on Assumptions [l]-|2l 

III. DS/MC-CDMA IN Frequency-Selective Channels 

We now extend the incremental matrix expansion approach to determine the a.e.d. of a sum 
of matrices which are not free, corresponding to the received correlation matrix in a DS/MC- 
CDMA system. In doing so, we determine the asymptotic SINR of the MMSE receiver for this 
system. 



A. System Model 

The following multi-user DS/MC-CDMA system model accounts for frequency-selective chan- 
nels, and applies to 

• the uplink of a single-cell system with multiple signatures per user^ , or 

• the downlink of a multi-cell system with a single (or multiple) signature(s) per user . 
The received signal is given by 

J 

r = EHAAA + n (47) 

'This model with Aj — Ik^ is considered in [18], however an approximation is used there to compute the SINR associated 
with isometric signatures. 
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where 

• Hj is an N X N complex-valued matrix representing the channel from the j*^ transmitter to 
the base station. We assume that the matrices H^H], j — 1, . . . , J are jointly diagonalizable, 
that is, there exists a unitary N x N matrix V for which VHjHtV^ is diagonal for all 
j. For MC-CDMA, each is diagonal, and for DS-CDMA (with a cyclic prefix for 
each symbol) each HjHj is diagonalized by the discrete Fourier transform matrix. Assume 
-f^max = sup^maxjxj ||HjH]|| < oo. 

• Sj — [sj^i ■ ■ ■ Sj^Kj] is an A?^ X Kj complex-valued signature-sequence matrix which contains 
either 

- random orthonormal columns, i.e., we assume that each is obtained by extracting 
Kj < N columns from an independent N x N Haar-distributed unitary random matrix, 
or, 

- i.i.d. complex elements^ with mean zero and variance (for example, i.i.d. Gaussian 
real & imaginary parts ~ N(0, 2^)), such that Sj is unitarily invariant. 

We shall call the first case 'isometric S^', and the second case 'i.i.d. Sj', as in [12, 14]. 
Note that a mixture of i.i.d. and isometric signatures across j is permitted in this model. 

• Aj is a Kj X Kj, diagonal, complex- valued matrix of transmit coefficients, i.e. Kj = 
diag(Aj_i, . . . , Aj^Kj)- In fact, the results which follow depend only on the values of Pj^k = 
|Aj^fep, and so to simplify notation, without lack of generality, we may assume Aj^k, k — 
1,. . .,K, is non-negative and real valued. Note that Pj^ is the transmit power of the A;* 
signature of transmitter j. 

• The complex Kj x 1 vector hj contains the transmitted data symbols. Elements of are 
assumed to be i.i.d. with zero mean and unit variance. 

• n contains i.i.d., zero mean, circularly symmetric, complex Gaussian entries with variance 
per dimension (7^/2. 

• Hj, Sj, Aj, bj, j = 1, . . . , J and n are mutually independent. 

The output of the MMSE receiver for the k"^ signature of the transmitter is given by 

h,{k) = cy (48) 

*For technical reasons, we also require that the elements have finite positive moments. 



Submitted to IEEE Trans. Info. Theory - Nov. '05 



10 



where 

Cj^k = Aj-,fcR"^HjSj-fc (49) 
J 

R = ctIIn + ^(H,S,A,)^ (50) 

Identifying the signal and interference components of the received signal in (l47t . i.e., r = 
Aj^kiijSj,k^j{k) + r/, the corresponding output SINR is 



_E[lsyr-r,) 
Eilcl 



SINR \ = ^ (51) 

J'*^ cri„t r 121 



= Pj,kpf,k (52) 
where the expectation in (l52b is with respect to n and bj, i = 1, . . . , J, and 



= sJ^,H]R. ^H,s,,, (53) 



where R^^ = R - (A^- ^H^s 



it 



B. Asymptotic MMSE SINR 

We wish to evaluate the limiting SINR in (15^ as and Kj — > oo with Kj/N aj for each 
j = 1, . . . , J. Under this limit, it is shown in Appendix IIVI that 



where 



V^M\Pi,k- Pi — ^0 (54) 



^tr[H5R-iH,] , i.i.d. S„ 

pf = < ' (55) 

[^tr[T,HtR-iH,] ,iso. S„ 

and T, = - S,S]. 

Computing the limit of for J = 1 is well known [12,23], and has been derived using an 
incremental matrix expansion approach in [14]. However, the extension to J > 1 is nontrivial. 
For J > 1 and Aj = I^j, j = 1, . . . , J, this problem is considered in [18], where the solution 
for i.i.d. signatures is obtained using [20, Theorem 16.3], and an approximate solution is derived 
for isometric signatures. 

We now present an exact expression for the asymptotic SINR for J > 1 by extending 
the incremental matrix expansion approach. The following theorem is in terms of the Stieltjes 
transform of the e.d.f. of the eigenvalues of J2j=i(J^j^j-^j)^^ from which the asymptotic MMSE 
SINR is an auxiliary result. That is, we redefine R = —zIm + X]j=i(HjSjAj)t, where z E 
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such that the Stiekjes transform of the e.d.f. of the eigenvalues of J2^=i(^j^j-^jY given by 



The theorem is given in terms of the 2 J additional random variables E C"*", j = 1 . . . J, 
as defined in (1551) . using the redefinition of R mentioned above, and rf e C+, J = 1 . . . J. The 



variable Tj is defined in terms of matrix equations in Appendix |IVl however, as the definition 
of is lengthy, and is not needed to state the following result, to facilitate the flow of results 
it is not stated here. 

Theorem 1 Assume that the e.d.f.s of the eigenvalues o/HjH| and AA^ converge in distribution 



almost surely to compactly supported probability measures on M* as {N, Kj 



oo with 



Kj/N aj > 0, j = 1, . . . , J. Then the Stieltjes transform of the e.d.f. of the eigenvalues 
of J2'j=i(H.j^j-^j)^' i^)' -2 £ along with and , j = 1 . . . J satisfy 





» 


^0, 








pf- 


pj 




j 


= 1. 


.J, 






^0, 


j 


= 1. 


.J, 



(56) 
(57) 
(58) 



where Gr{z), pj,Tj G C+ are solutions to 
Gr(z) = 



M 1 - ^ ajPjVj 
\ j=i 



Pj 



^1 



f i.i.d. Sj, 
, iso. Sj. 



1 - ajPjVj 



i. i. d. S J , 
iso. Sj. 



(59) 



(60) 



(61) 



where 



Hi 



E 
E 



P. 



1 + P,p, 



(62) 
(63) 



and the expectation in \63^ is with respect to {-f^j}j=i,...,j, where Hi is a scalar random variable 
according to the a.e.d. o/HjH|. Similarly, the expectation in A62\l is with respect to Pj, a scalar 



random variable according to the a.e.d. of AjA^-, and pj = E[Pj]. 



Proof: See Appendix ITVI 
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We have the following remarks concerning Theorem [T] 

• If (I5^-(E^ has a unique solution G^{z), pj, tj E C+ for any given z E C"*", then Theorem 
[T] additionally gives that the e.d.f. of the eigenvalues of (HSA)^ almost surely converges in 
distribution to a deterministic distribution, whose Stieltjes transform is Gr{z). Moreover, we 
have that converges almost surely to the deterministic value pj in the limit considered, 
and so, letting z = — + ej and taking e — 0, as indicated by (l52b . (l54b . and (l57t . the 
asymptotic SINR of the k^^ data stream of the transmitter almost surely converges to 
Pj,kPj- 

• The solution, at a given value of z, requires solving the 2 J + 1 equations (l59b. (l60b . and 
(IGTT) . which contain 2 J + 1 variables, i.e., Gr{z), pj, and for j = 1, . . . , J. 

m For the special case of Aj = Ik^ and i.i.d. Sj for all j = 1, ... , J, Theorem [T] can also be 
obtained from [20, Theorem 16.3].'' 

• To find the SINR, the approximate method in [18] requires solving J sets of equations, each 
of which contains 2 J + 1 variables. In contrast. Theorem [l] states that solving one set of 
equations in J (independent) variables gives the SINRs for all signatures of all transmitters. 

• If the channels of the transmitters are independent, then the expectation in (l63t becomes 

n,= [■■■ f rj-dFH,{h) . . . dFH,{hj) (64) 

J J -z + Y,^{a,- T,)hi 

If we further assume that the a.e.d. of each H^Ht is discrete, i.e., has the form 

fHm{hm) = ^Pm,nS{hm - Pm,n) (65) 
n=l 

where (3m,n ^ [0, 1] and Y^n=i P'm.,n = 1 for each ra = 1, . . . , J, and Np is some finite 
positive integer, then 

Np 

n, = J2---J2 — J — (66) 

ni=l nj=l ~^ + X]i=l('^i ~ '^i)Pi,ni 

C. Example 

Consider two equal-power transmitters with ai = a2, where Hj in is exponentially 
distributed with unit mean. Figure [l] shows empirical values (numerically generated from aver- 
aging finite systems with N = 32 and QPSK modulation) and asymptotic values (determined 
from Theorem [l]) of Gji{z) and MMSE SINR. Also shown are the values obtained using the 

'The authors thank P. Loubaton for pointing this out. 
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(a) i.i.d. signatures (b) isometric signatures 

Fig. 1. Gr(z) vs. z: Asymptotic and empirical (A'^ — 32, BPSK, 5 x 10^ realizations) values, for two transmitters, a\ — a.2, 
Ai = A2 = Ik/2, E[iyi] = E[/f2l, Im(2) ^ 0, for a = 0.25 to 1.5 in steps of 0.25. 




5 10 15 20 25 30 35 5 10 15 20 25 30 35 

reference per-signature SNR (dB) reference per-signature SNR (dB) 



(a) i.i.d. signatures (b) isometric signatures 

Fig. 2. SINR vs. SNR: Same parameters as for Figure 



approximate asymptotic results of [18]. As expected, the exact solution matches the empirical 
values, and moreover, the approximate solution of [18] is seen to be very accurate. As mentioned 
previously, the computational complexity of the exact solution in Theorem [l] is significantly less 
than that of the approximate solution. 

IV. Conclusions 

Using the approach of [14], we have evaluated the a.e.d.'s of sums and products of unitarily 
invariant matrices, and obtained the same result as given by free probability theory. The derivation 
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given here is significantly simpler than the general proof for free non-commuting random 
variables as derived by Voiculescu, and indicates that for random matrices, "free" is synonymous 
with "unitarily invariant". 

We also derived the asymptotic distribution of a sum of non-free random matrices, correspond- 
ing to the receive autocorrelation matrix for a class of DS/MC-CDMA systems. This result is 
primarily due to an extension of [14, Lemma 6], given in Lemma fT2l which is interesting in 
its own right. Interestingly, the exact asymptotic results are very close to the results obtained if 
the non-free component matrices are (incorrectly) assumed to be free, although the accuracy of 
this approximation is not well understood. The applicability of this approach to other channel 
models (such as dispersive and possibly correlated multi-user MIMO channels, etc.) remains to 
be determined. In particular, the current approach requires H^hJ, j = 1, . . . , J, to be jointly 
diagonalizable. 

V. Acknowledgements 
The authors thank P. Loubaton for bringing references [20, 22] to our attention. 

Appendix I 
Auxiliary Results 

For the derivations which follow, we recall the following definitions and results from [14, 
Appendix I] concerning asymptotic equivalence and uniform asymptotic equivalence of random 
sequences. 

A. Asymptotic Equivalence 

Definition 1 Let {aAr}Af=i,... and {&Ar}Ar=i,... denote a pair of infinite sequences of complex- 
valued random variables indexed by N. These sequences are defined to be asymptotically 
equivalent, denoted x bj^, iff — bj^\ a^' ^ oo, where denotes almost- 
sure convergence in the limit considered. □ 

Clearly x is an equivalence relation, transitivity being obtained through the triangle inequality. 
We shall additionally define asymptotic equivalence for sequences of x 1 vectors and N x N 
matrices in an identical manner as above, where the absolute value is replaced by the Euclidean 
vector norm and the associated induced spectral norm, respectively. 
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Lemma 1 If and xn x y^^, and if {a^l, \yN\ and/or \hM\, \xn\ are almost surely 

uniformly bounded above^ over N, then a^x^ ^ bj\fyj\f. Similarly, aj^/xjy x b^/yN if kiv| or 
I^atI is uniformly bounded above over N, and at least one ofinip^ \xiy\ and infjv \yN\ is positive 
almost surely. 

Note that the mukiplicative part of Lemma d holds for any mixture of matrices, vectors or 
scalars for which the dimensions of and xn are such that a^XN makes sense, due to the 
submultiplicative property of the spectral norm. The following definition and related results, 
however, are concerned with scalar complex sequences. 

Definition 2 Let {{aiy^n}n=i...N}N=i,... and {{biy^n}n=i...N}N=i,... denote a pair of infinite se- 
quences, indexed by N. The N''^ element is a complex-valued sequences of length N, indexed by 
n. These sequences are defined to be uniformly asymptotically equivalent, denoted ajsf^n ^ &Af,n. 

/j^maX„<Ar |aAr,„ - 6Ar,n| a* ^ CX). □ 

Also, we define and b^^n as being uniformly asymptotically equivalent (denoted x b^^n), 
if a^^n ^ &Af,n where a^v,™ = for all n = 1, . . . , A^. 
Also, analogous to Lemma [H we have 

Lemma 2 If a^n ^ ^Af,n and x^^n ^ yN,n, and if \aN,nl \yN,n\ and/or \bN^n\, \xN,n\ are almost 
surely uniformly bounded above over N andn, then aN,nXN,n ^ bN,nyN,n- Similarly, aj^^n/xN^n ^ 
bN,n/yN,n if \ciN,n\ or {b^^nl is almost surely uniformly bounded above over N and n, and at 
least one ofmi^n \xN,n\ and inf7v,n \yN,n\ is positive almost surely. 

B. Proving Asymptotic Equivalence 

The following results are required in order to prove asymptotic equivalence. 

Theorem 2 If E[|X|^] < oo for r > (not necessarily an integer); then 

Px i\X\ > e) < ^Lll (67) 

for every e > 0. 

For r = 1, Theorem 12 is often called Markov's inequality. For X substituted by (X — E[X])^, 
where X has finite mean and variance, and r = 1, Theorem El is often called Chebyshev's 
inequality. 

*A sequence {ajv}iv=i... of complex-valued x 1 vectors or scalars is uniformly bounded above over A'' if sup^^ |a]v| < oo, 
or in the case of complex-valued N x N matrices, sup^y ||ajv|| < oo. 
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Lemma 3 (The Borel-Cantelli lemma) Let {Ej\f G J-"} n=i,2.... denote a sequence of events in 
the probability space (fi, JF, V). If 

oo 

{En) <oo (68) 

N=l 

then the probability that an infinite number of the Ei 's occur is zero. 

Example 1 Showing almost-sure convergence of the sequence {Xiy}N=i,2... reduces to demon- 
strating that E[|XArp] for some m > 1 is 0(A^^"), where n > 2 (typically, m = 4 and n = 2). 
Then, from Theorem |2l we have 

Px. > e) < ^ (69) 

for e > and some finite, positive c, independent of A^. Moreover, S69h implies 

oo 

^Px^dX^I >e) <oo (70) 

N=l 

due to the fact that n > 2. Finally, from (TTUt and Lemma|3J converges to zero almost surely 
as ^ oo. 

Lemma 4 [8, Lemma 1] Let Cn, be an N x N complex-valued matrix with uniformly bounded 
spectral radius for all N, i.e., sup^ IICatH < oo, and y = [Xi, . . . , XArj^V^, where the Xi's 
are i.i.d. complex random variables with mean zero, unit variance, and finite eighth moment. 
Then 

E[|ytCy-tr[C]n<^ (71) 
where the constant c > does not depend on N, C, nor on the distribution of the Xi. 

Lemma 5 Let S be K < N columns ofanNxN Haar distributed random matrix, and suppose 
s is a column of S. Let be an N x N random matrix, which is a non-trivial function of all 
columns ofS except s, and B = supjy ||XAr|| < oo. Then, 



1 

s^XtvS tr HXat 



where H = I^v — (SS^ — ss^") and C is a deterministic finite constant which depends only on 
B and a = K/N. 

Proof: This result is a straightforward extension of [13, Proposition 4]. ■ 
Due to Theorem |2l and Lemma |3l an immediate consequence of Lemmas |4l and |5] is that 

y^Cy X tr[C] and s^XjvS x jy^j^ tr[nXjv] respectively, as explained in Example [T] above. 
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Lemma 6 Suppose a^v,™ ^ as defined in Definition^ Let {{cN^n\n=i...N} n=i,... denote an 
infinite sequence, indexed by N, of sets of real-valued sequences of length N, indexed by n. 
Additionally assume that 

6 = inf |Im(a7v,n)| > 



almost surely, and that a^^n and/or b^ is uniformly bounded above over N and n. Then 



1 


n 


1 


1 + CN,n(lN,n 




1 + CN,nbN 


0'N,n 


n 


bN 


1 + CN,n(lN,n 




1 + CN,nbN 


CN,n 


n 


CN,n 


1 + CN,nO'N,n 




1 + CN,nbN 



(73) 

(74) 
(75) 
(76) 

Proof: Firstly, if CN,n = for any and n < N, then (l74b is clearly true. So, consider 
CN,n 7^ 0. Denote B = sup^ \bN\ < oo. Consider a realization for which max„<Ar \ aN,n — ^a^I 
holds. Note that for any and n < N, 6 < \lm{aN,n)\ < \^T^io.N,n — ^tv)! + |Im(6Ar)|. Hence, 
take sufficiently large such that max„<jv |Im(a7v_„ — fo^v)! < 5/2, so that |Im(6jv)| > 5/2. 
Moreover, note that \l + CN,nbN\ > |cAr,n Ini(&Af)| > \cN,n\5/2, and similarly \l + CN,na'N,n\ > 
\cN,n\ 5, due to the inequality |1 + Dx\ > \D\ Im(a;) for G M and x E C^. We then obtain 

CN,nO'N,n CN;nbN 



1 + CN,n(lN,n 1 + CN,nb_ 



'N 



< 



1 + CN,nO'N,n 1 + CN,nbN 
+ 

\aN,n — bN\ 



\cN,n\ 






1 + CN,na-N,n 







CN,n 


2 


bN\ 


a'N,n — bN 




1 + CN,naN,n 


|1 + CN,nb 


n\ 



1 / 2B 
^-5V^- 



(77) 



Taking a maximum over n, and using the facts that aN^n ^ bN, B < oo, and 5 > gives (IT?!) , 
assuming is uniformly bounded above for all A^. The remaining case, where aN,n is uniformly 
bounded above, is shown in an identical manner. 
To show ( 1751 . note that 

1 - - ICN^nO'N.nl 



|1 + ,n I 

Using (iTTb and dTSt gives 

0'N,n bN ^ 



1 + CN,na-N,n 1 + CN,nb 



N 



< 1 



1 + Cn^O-N 



< 1 



2B 



< 1 



1 + CN,n(^N,n 

2B 



+ \b 



N\ 



1 + CN,nO'N,n 



CN^nb 



N 



(78) 

(79) 
(80) 
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which implies (1751 . Finally, dT^ is obtained due to 



1 + CN,nClN,n 1 + CN,nb 



N 



(81) 



Lemma 7 If ajy^n ^ i>N,n cis defined in Definition^ then Yln=i '^n,^ 
Proof: This follows immediately from 



1 Y-A^ I, 



1 ^ 
n=l 



< max \aN,n - hN,n\ 

n<N 



(82) 



Lemma 8 [14, Lemma 5] For N = 1, . . ., Zef X^v = Mat — zIn, where Mtv is an N x N 
Hermitian matrix and z E and suppose u^v G C^. Denote Un = u]yX^^U7v- //^ 



Then 



b = inf lujvl > a.s. 

N 

B = supIIXatII < oo a.s. 

N 



Im(M7v) > lm{z)— a.s. 



(83) 
(84) 

(85) 



and hence un G almost surely. 

Lemma 9 [2, Lemma 2.6] Let z e A and 'B N x N Hermitian, r G M, and q G C^. T/ien, 

lAII 



|tr [((B - zl)-^ - (B + rqqt - zl)-i) A] | < 



Im(2;) 



(86) 



C. Asymptotic extensions of the matrix inversion lemma 

Lemma 10 [14, Lemma 6] Let Y^r = Xat + v^ruj^ + uatvJ^ + CAfUAruj^, where v^, G C^, 
Cat G M*, and Xat = ISA^ — zl^, where 'WLn is an N x N Hermitian matrix and z G C+. Denote 



— ujvXjy"'"VAr 
Un = ujyX^-'-UAr 

Vn = vIvX^Vat 



(87) 
(88) 
(89) 



Assume that as N ^ oo, 



leNl — ^ 



(90) 
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and 



b = inf IuatI > , a.s., 

N 



B = supmax{||X7v||, |vAr| , |u7v| , |cAr|} < oo 



TV 



Then, 



X^^(uAr - UnVn) 



1 - Un{vn - Cat) 



1 - U^ivN - Cat) 



as N CO, and 



6 = ini \1 — unIvn — cn)\ > 



(91) 
(92) 

(93) 
(94) 

(95) 



almost surely, where 5 depends only on B, b, and lm{z). 

Lemma 11 [14, Lemma 7] Let be an NxN Hermitian matrix, and suppose A = supjy || A^vH < 
oo. Using the definitions and assumptions of Lemma additionally define 



-(2) 
'TV 



UN — U^n^N-^n'^nUm 



Then, 



as N 



^ r A v-n , "^nVn + {vn - Cn)un - £ 
J^j^ \ H 



(1) 

N 



-(2)' 
'N 



1 - un{vn - Cn) 



^0 



(96) 
(97) 
(98) 
(99) 

(100) 



oo. 



We require the following extension to Lemma [K 

Lemma 12 Let = X^r + J2j=i (^^nj^n + ^n^nj + cnju^u^j^^, where ujy, v^rj G C^, 
cnj € M*, J is a finite positive integer, and X^f = WIn ~z\n, where IsAn is an N x N Hermitian 
matrix and z G C^. Denote 



XN,i,j = ^NA^N^^NJ , i^j- 



(101) 
(102) 
(103) 
(104) 
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Assume that as N ^ oo, 



I I n 
\^N,j\ ^ U, 

a.s 



\Xn., 



,tj^J, 



for all i, j G {1, . . . , J}, and 



inf IuatI > , a.s., 

N 

B = sup maxmax (IIXatII, |u7v| , |vArj| , IcatjI} < oo 

N 3<J 



(105) 
(106) 

(107) 
(108) 



Let dj^j = Cat J — v^j. Then, 

X"^ (vln - UN Y.j "^N,j 







1 + un dN,j 



1 +UN^jdN,j 



as N ^ OO, and 



6 = inf 

N 



> 



(109) 

^0 
(110) 

(111) 



almost surely, where 6 depends only on B, b, and lm{z). 
Proof: See Appendix IVl 

Lemma 13 Let be an N x N Hermitian matrix, and suppose A 
addition to the definitions and assumptions of Lemma C21 define 





— ujyXjy-'-AivX^-^VArj 






= vjyjX^-^AArX^-'-UAr 




UN 


t 1 1 






= vIvj-X^^AatX^Vtv^j 




XN,i,j 







and assume that as N ^ oo 



\Xn., 



, ^ ^ J 



sup AT ||Ajv|| < oo. In 

(112) 
(113) 
(114) 
(115) 
(116) 

(117) 



for all i, J e {I,..., J}. 
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Then, 



1 MTV '^N,j - UN Ej dN,j - Ej(^!ij + ^n]]) 



N,j 



(118) 



Proof: This can be shown from Lemma [TT] and Lemma [121 using induction on J. 



We first show ma.Xk<K \ Pj 



N 



Appendix II 
Proofs for Section Hl-Bl 



pN\ _f:f:^ g j-j^g limit considered. Define 



Pj,k 
N" 

Pj,k 



1 



N-K 



From Lemma |5l Theorem |2l and Lemma |3l we have 



max 

k<K 



Pj,k Pj,k 



^0 



(119) 
(120) 
(121) 

(122) 



in the limit considered, as explained in Example [T] in Appendix U We now consider a realization 
for which (11221) holds. We obtain 

1 , , _ 2 



Pj,k Pj,k 



I 

\PjM 



< 



N-K 



Pj,k 



N-K 
2 

< —- r-r^l|Tj-fcC . . ||rank(Tj-, 



(123) 
(124) 

lm{z){N-K) ^^^^-^ 
where the first inequality follows from (11221) with sufficiently large, and (11241) follows due 



< 



{N - Kf 
2 



to tr[X] < ||X|| rank(X), and we have used ||Cj.^|| < 1/Im(2;) 
N — K. Additionally, from Lemma |9l 



- i-.k I 



N" 
Pj,k 



< 



lm{z){N-K) 



1 and rank (Tj.k) < 



(126) 



So from (fT22l) . (fT25l) . (fT26t and 



^.7 - 



Pj Pj,k 



+ 



Pj,k Pj,k 



Pj,k Pj,k 



(127) 



we have that maxk<K Ipffe — P 



in the limit considered, as stated in dlOb . 



We now use (fTUI) and Lemma |3 to show dTTl and dTSl . where n, aN,n, b^, and ctv,™ in the 
lemma correspond to k, p^j^, , and Dj k, respectively. Checking the conditions of Lemma |6l 
Dj k is real-valued and \p^\ < Im(z)^^, so it remains to show that (17^ is satisfied. To do this. 
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note that Lemma [5] may be applied to p^i^, since |vjfc| = 1 and ||Cj,fc|| < JD^^x + \z\ < oo. 
Therefore, G C+ almost surely, which establishes (l73t . Therefore, (l74l) and (l75b of Lemma 
ilgive (El) and (UU). 

Appendix III 
Proofs for Section Hl-Cl 



We first show that, in the limit considered, maxfc<i^ Itt,^ 



i,k 



TT, 



N\ 



for i = 2 is analogous. Define 



TT 



N' 

l,k 



1 



TT 



AT" 



N-K 
1 



6-1 

A: 



:tr 



Ti,fcD2V2B- 



for i = 1. The proof 

(128) 
(129) 



where Ti ^ is defined in (I121II . Using the same steps as taken in the proof of dlOb in Appendix UU 
it is straightforward to show that maxjt<i^ Wik ~ ^fll 0' and using a realization for which 



N' 



this holds, that 1 7r{ i. 
following lemma. 



7r 



AT" 

l,k 



0. However, in order to show Itt^ — n 



rN"\ 

l,k 



0, we require the 



Lemma 14 For N x N Hermitian Xi and X2, v, u G C , z G C+, /e? 

t;^ = v^XsB^^u 
where U2D2UI is the s.v.d. of X2 such that U|U2 = ^k, cind 

A = D|u|XiU2D2 - zIk 



B = X1X2 - zl 



N 



(130) 
(131) 

(132) 
(133) 



Then Vn 



Vb- 



Proof: The proof is easily obtained using induction on the rank of Xi, and the matrix 
inversion lemma. ■ 
Note that we can write tt]^^' = J2'e=i^ ^1 t^'i^il^i/^ where Si^^ is defined via Ti = 
'^'(=1^ ^i/s[ ^. Moreover, we may apply Lemma[l4lto each term in this representation, and write 
the result as matrix trace. The same argument applies to (we omit the details). It can then 
be shown that Lemma can be applied to — '^i,k\ using this alternate representation. The 
result is 

D 



TT 



N 



TT 



N" 

l,k 



< 



lm{z){N -K) 



(134) 
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Combining the preceding results, we have that raax^KK j^rf^ — in the limit con- 

sidered, as stated in (l34l) . 

We now show (l40b - (H2ll using Lemma |6l analogous to the proof of (flTt and (fTSt in Appendix 
mi Here, n, aN,n, bN, and CN,n in the lemma correspond to k, vrf^, tt^ , and Dj^k, respectively. 

In this case, we note that \7^i\ < -Dmax which is the required uniform upper bound 

on the term corresponding to b^^ in the lemma. In addition, in order to satisfy condition (iTSt . 
note that Lemma[51may be applied to -k^^, after writing vrj^^ = v| ^V2D2(B| fc)^^D2V2Vi ^ 
using Lemma [141 where Bi ^. = DgVgXi fcV2D2 — zIk- To show that the condition d83l) is 
satisfied in the application of Lemma El note that Lemma 13 implies 



max 

k<K, 



v^X2Vi,fc - ^tr[X2] 



a.s. 



(135) 



in the limit considered. Moreover, |-i:tr[X2] — E[-^2]| -—^ due to O, and £[^2] is positive 
due to the assumption that the distribution of X2 does not have all of its mass at zero. 

In summary, |7rf^| is uniformly bounded above, and 7rj\, G C+ almost surely due to Lemma 
IHl which together imply that Lemma lH may be applied to give (l40b- (l42|l . 

Appendix IV 
Proof of Theorem m 

Note that since the e.d.f.'s of the eigenvalues of HjHj and Pj = A| converge in distribution 
almost surely to compactly supported distributions, we have 

1 ^ 

lim ^5^fp,,.) = E[iiHj)] (136) 

k=l 
Kj 

lim ^^f(P^.,) = E[f(P,)] (137) 

for any bounded, continuous function f on the support of Hj and Pj, respectively. In order to 
simplify the proof which follows, we also assume that \z\ < 00. 

We seek 7^ = G^{z) = -^tr[R~^]. To this end, first consider removing column k from Sj. 
The matrix inversion lemma gives 

R^^hj-fc = — ^Rd hj-fc (138) 

i + Pj,kPj,k 

where R^. , = R - P,-,fchJ h^- ^ = H^s^-fc, and pf^^ = hj ^.R-^^h^- fc. 
Under the limit considered. 
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where 



kr[H'R-iH, 



N 

^tr[T,HtR-iH,] 



, i.i.d. Sj, 
, iso. S,, 



(140) 



and T, 



In - SjS]. This can be proven following the same steps as the proof of (flOb in 



Appendix mi where Lemma |4| is used in place of Lemma |5l for the first step with i.i.d. Sj, and 
where the bounds obtained also depend on Hmax, which is finite by assumption. 
Also, note that under the limit considered. 



max 

k<K, 







(141) 



from the Borel-Cantelli lemma. Lemma |4l Lemma |5l and (11361) . Moreover, since the distribution 
of Hj does not contain all mass at zero, E[iJj] is positive. 

We now focus on a realization for which (11361) . (I137I) . ( 11391 ) and (11411) holds. Applying (11381) 
to an expansion of the identity I^r = RR^^, we obtain 



^ J ^3 J p 



j=i k=i 

Using Lemma it can be shown that for any j 



I,..., J, 



max 

k<Ki 



N 



Pj,kP 



N 



k=l 







(142) 



following the same steps as the proof of (flTb in Appendix |ll| The only significant differences 
are that (|141l) is used to satisfy condition (l83t of Lemma [H and we also require the fact from 



[24] that IIS,- 



1 + 



/aj. 



Hence from (11421) and (I143I) . 



1 + zj 



N 



J 



'1^3 ' 3 



V 



N 



I 

3 k=i ^ ' ^ ■'^i 



Ki 

-E- 



(144) 



(145) 



Until this point, this derivation differs little from that encountered in Sections III-BI and III-CI 
To proceed, we need the following extension of [14, Proposition 2]. 

Proposition 1 For the model I147\I . the distribution of both the Stieltjes transform of the e.d.f. 
of the eigenvalues o/ ^^^^(HjSjAj)^ and the MMSE SINR are invariant to the substitution of 
VDj for Hj, where \ is an N x N Haar-distributed random unitary matrix, and Dj is an 
N X N diagonal matrix containing the singular values of Hj. 
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Proof: For some N x N Haar distributed matrix T, note that 

J 



7^ = ^tr[R-i] = ^tr[TTtR-i] ^ ^ tr[(-;.I^ + ^(TH,S,A,)^)-^] (146) 



and 



pf = ^tr[H]R-iH,] = ltr[HjTtTR-iTtTH,] (147) 

1 ^ 
= -tr[(TH,)n-^Iiv + 5^(TH,-S,A,)^)-^(TH,)] (148) 

i=i 

Writing TH^Sj = (TU^ i)Dj(Uj2Sj), where Uj iDjUj2 is the singular value decomposition 
of Hj, the unitary invariance of T and Sj gives the result. ■ 
Therefore, in the remainder of this appendix, we substitute Hj with VDj everywhere. We denote 
the column of V and S] as v„ and respectively, 1 < n < N. Denote the diagonal 
elements of Dj as {dj^i, . . . , dj^N}- 

In contrast to the derivations in Section III-Bl note that if (H^SjAj)*, j = 1, . . . , J, were 
free, instead of taking = VDj, we would set Hj = V^Dj, where Vj, j = 1, . . . , J, are 
independent N x N Haar distributed random unitary matrices. This is the key departure point 
of this (non-free) derivation from the (free) derivations of Section |nl 

Now consider the removal of the column of V, for some < n < N, i.e., 

J 

R = -zIn + 5^((H,- i„S,,i„ + rf,,„v„sJ^J A,)* (149) 
J 

= Rtn + XI ^i.'^^i."^" + dj,n^nu]^^ + dl^Cj^n^n^i ( 1 50) 

where 

R,„ = -^I^ + 5^(H,,„S,,„A,)t (151) 
^j,n = Hj-i„Sj-t„A|sj-„ (152) 

Cj^ri ^j,n"^j ^ii*^ (153) 

and Hj and Sj denote Hj and Sj with their n}'^ column and row removed, respectively. 

In what follows, we shall apply Lemma fT2l and Lemma fT3l to (I150I) . where Y^, Xat, va? j, ujy, 
and cnj in the statement of Lemma fT2l correspond to R, R^,^, (ij „Uj „, v„, and Cj „, respectively. 
We shall now verify that the conditions of the lemmas are satisfied. 
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Define = uj^R^Ju^-n. Since Rt„v„ = -zv„,, we have 



(154) 
(155) 



and (11551) implies condition (I105I) . It can be shown that for i j, ul^H^^uj^n in the 
limit, satisfying condition (I106I ). This is clear for Sj and Sj i.i.d. from [8, Corollary 1], and 



for isometric Sj and/or Sj the proof requires considering 
condition (11071) is satisfied, and finally condition (11081) is satisfied by assumption. 
Now, note that due to Lemma |5J Lemma and the Borel-Cantelli lemma. 



Since |v^ 



1, 



max \ Cj^n — otjPj 

n<N ' 







in the limit considered, where pf = ^ ^k=i ^j,k- 
In Appendix IVIL we show that 



\ N N\ 

max r, „ — r,- — 



^tr[H,S,A^S|H;R-i] 



i.i.d. S,, 



iso. Sj. 



We will now focus on a realization for which (11361) . (11371) . (11561) and (11571) holds. 



In order to determine rj^, first note that 



ltr[H,S,A}StHtR-i] 



a. 



k=l 



from which we can obtain 



-tr[H,S,A5stHtR-i] - a,{pf - Vf 



in the limit considered, in the same manner as the proof of (11441) . 
Considering rj^ when Sj is isometric, using SjSj = we have 

ltr[H,S,AjStHtR-i] = ltr[H,S, AjSjS, A^SjHtR-i] 



N 



1 ^ 

'J^ ^ ^ tr [(Uj + (ij,nCj,jiVn) (Uj^n + (ij^^Cj^^V„)^R ] 



n=l 



Focusing on the argument of the sum in (11621) . we have from Lemma [T21 that 



(c- 



N - 



(156) 



(157) 
(158) 



(159) 



(160) 



(161) 
(162) 



(163) 
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where we have used Lemma \T7\ in order to simplify the terms corresponding to un, vnj, £n\' 
and . Using (11561) and (11571) . it is straightforward to show that in the limit considered 



max 

n<N 



and hence combining (11601) . (11621 ). ( 11631 ). and ( 11641 ) we obtain 

|rf - «,(p-f - ) + - rf )^7^f I 



(164) 



(165) 



in the limit considered, where 



njN 

3 N 



1 ^ 



n=l 



(166) 



In order to determine pj^, note that 



1 1 ^ 

-tr[H]R-iH,] = -5^4„trKvtR-i]. 



(167) 



Focusing on the argument of the sum in (11671) . like ( 11631) . we have from Lemma [O] that 

1 



max 

n<N 







Using (11561) and (11571) . it is straightforward to show that in the limit considered 

1 1 



max 

n<N 



and hence combining (11671) . (11681 ). and (11691 ) we obtain 

itr[HtR-iH,] - T^f 







0. 



(168) 



(169) 



(170) 



In addition, considering the term -i:tr[HjSjS|HjR ^] which appears in the expansion of for 



isometric S,, we have 



tr[H,S,SjHtR-i] - a^.pf (1 - pf 



N 

which is proven in an identical manner as (11601) . 
Combining (fT?UI) . ( flTDt and ( fTTlT) . we obtain 



(171) 



1 — a, 



y , i.i.d. Sj, 



, iso. S,. 



(172) 
(173) 



It follows that for any realization for which (fT36b . (fT37l) . (fT44l) . (fTM . (fT65l) . (fT72l) . and (fT73l) 

hold, [7^ — 7I ^0, — Pi| ^ 0, and |rj^ — r,| ^ 0, where 7, pj, and r^, satisfy (l59t-(l62t. 
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Appendix V 
Proof of Lemma [T2l 

The proof of Lemma fT2l is by induction on J. We drop the subscript for brevity, such that 
Xat, Yjv, ujv, vatj, and cnj are denoted X, Y, u, vj, and cj, respectively. Define X(o) = X, 
and 



for j 



1, . . . , J, noting that Y = X(j). The proof also depends on showing that 



(0)' 



, j>i. 



(174) 



(175) 



for i = 1, . . . , J. 

Clearly, for J = 0, (I109l) - (ll 101) and (11751) are true. Therefore, let us assume the hypothesis 
is true for all J less than some fixed /, and consider J = I. Proving that (11751) holds for i = I 
under the inductive assumption can be shown as an auxiliary result in the proof of Lemma O 
in [14, Lemma 6] under the assumption (I106I) . Now, in order to apply Lemma fTOl to X(/), we 
check the corresponding conditions. 



. Note that 



--1 



< Iu| 



^(7-i)^i 



+ |eAro|, and hence due to (11081) . the 



-1 



0. Hence condition (l90b 



induction assumption (11751) . and (11051) we have 
of Lemma [TOl is satisfied. 
Assumptions (I107I) - (I108I) imply conditions (l9]T)-(l92l) of Lemma fTOl since ||X(/) 
75^(2 + B) < oo from the triangle inequality. 
From the induction assumption we have 



< 11X11 + 



u^X 



(7-1) 



u 



UN 



1 + un Y.j=l dN,j 

v|X(7_i)V/ - Vn,I 







Therefore, from Lemma [TOl and (I176I) - (I177I) . it is straightforward to obtain 



(176) 
(177) 



Y^u 



-V/ 



MJV 



d 



NJ 



Y-1 



V/ 



1 + 



«5i 



d 



NJ 



(178) 



(179) 



The result is obtained from (I178I) - (I179I) after substituting the expressions for X^^^^^^u and 



X,^^^sV/ obtained via induction, and simplifying. 
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Appendix VI 
Proof of max„<Ar |r^^„ - r/^| ^0 



A. Ltd. So 



Define 



N 
1 



(180) 
(181) 



N ^N'\ ^ g aijj^Qsj surely from Lemma El and the 
Borel-Cantelli lemma. Now, u] „R^";^Hj- t,^Sj- A^Sj^^H]^^Rj";V„ = in analogy with (fT551) . 

suPtv WaA^'HMj < ^' and 



As with (|122l) . we have max„<Ar |rj^^ — rj „ 



AT' AT" 
T- — T- 



(182) 



So, Lemma fT51 applies to ( 11821 ). from which we obtain max„<jv — t^'I 0. 



Also, 



T- — T- 



-tr[R-i(H,,„S,,„A5st,^Ht,,^ - H^S^A^StHj)] 
^tr[R"^(dj>Uj>v], + c?j>v„uj„ + rf^c^.„v„vj,)] 

< ^ (2 |R"'u,,„| + |4„| |R-V„|) 



(183) 



From our assumptions and the application of Lemma [121 it is clear that the terms inside the 
bracket of (11831) are uniformly bounded (i.e. independent of n and A^), so max„<Ar |rj^" ~ Tf\ 
as well. 

Combining the preceding results with the triangle inequality, we have max„<7v |Tj^„ — Tj 

0. 



B. Isometric Sj 
Let m,n & {1, 



, A^} with m ^ and consider some j G {1, . . . , J}. Define 



r' = 11 

// ' t "R ~ 1 ' 



(184) 
(185) 
(186) 
(187) 
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where 

^j,n,m = ^j,tn,m.^j,tn.m-^j^j,n = Uj„ — d j ^^A. jSj m (188) 

Uj,n,m = H„t„^„S,-t„„„A2E^^,0j^„,^e„ (189) 

N 

^n,m = e„ej„ + emel + ^ e^ej (190) 

and e„ is an x 1 vector which contains zeros except for a 1 in the row. Note that Sj „ 
may be written as Ex^cj^^n, where E^^^ = [l^p OKj,N-Kj], and is the n}^ row of the x iV 
Haar matrix @j from which Sj is taken, i.e., Sj = ©jE^^^ and cu^ „ = 0]e„. 
Note that 



max 



max 



.t -R-l ..t 



a.s. 



a.s 



(191) 
(192) 



u;_„,„R-^;^v1„ = 0, Vm,nG{l,...,iV}, m^n (193) 



where (11911) and (11921) can be shown using standard arguments after writing Sj „ and „ as 
just described, and (11931 ) is shown in the same way as (11551) . We now focus on a realization for 
which Smh and S\97\i hold. 



Now, max„^„_(„^„) |rj- „ - r,- „,„| follows from Ir,- „ - r,- „_m| < 2 
( I191I ). and the fact that the latter two terms are uniformly bounded. 

Writing Tj^n,m = tr[uj,„^muj ^^R^^^] and similarly for rj „^, we have from Lemma fT3l that 
max„,„,(„^„) \Tj^n,m - '^j,n,m\ ^ 0' ^mcc the terms corresponding to un, v^^i, e''^]., and e%]- in 
the statement of the lemma converge to zero (independently of m and n) due to ( 11921 ) and (11931) . 

Finally, since 0j is unitarily invariant, and ^n,m is unitary {^n,m is simply the permutation 
matrix which swaps the n"' and entries), maxm_„^(m^„) \ T'j^n,m " '^'ln,m\ ^ 0- 

Combining the above results gives max^ ^ |rj „ — Tj ^^1 and moreover 

1 ^ 

|rf - rf^l <j-jY. - ^f-l ^ '^P"^ . I^-'-.- - ^^V-l ^ (194) 

m=l 
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